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FOREWORD & 
EXECUTIVE SUMMARY 


By Amber M. Northern and Michael J. Petrilli 


In today’s overheated education debates, no topic is more 
flammable than whether suspensions are a viable way to handle 
student misbehavior—and what to make of the differential 
suspension rates for minority and non-minority students. But 
regardless of where you stand on those questions, one thing 
seems certain: Self-discipline is far better than the externally 


imposed kind. 
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Where does self-discipline come from? Certainly it comes in part from home, family, church and the other 
institutions of civil society. But schools can make a difference too, and over the years Catholic schools— 
the largest provider of private education in the United States—have been particularly committed to the 


development of sound character, including the acquisition of self-discipline. 


How well has that worked? Given the widespread interest in, and the importance of, improving student 
behavior and reducing the need for harsh forms of external discipline, it would benefit all sectors of the 
education community to know whether children in Catholic schools actually exhibit more self-discipline than 
their peers—and if so, what other public and private schools might have to learn from them about how these 


positive behaviors can be fostered. 


To that end, this study asks two questions: 


4... Are children in Catholic elementary schools more self-disciplined than similar students in other 
schools, as measured by their likelihood of arguing and fighting and ability to control their temper, 
among other things? 


2. |sthe relationship between Catholic school attendance and self-discipline stronger for certain types of 
students? 


To lead the study, we recruited Michael Gottfried, Associate Professor at the University of California- 

Santa Barbara (UCSB). Dr. Gottfried has conducted several studies of young children’s socio-emotional 
development, social-behavioral skills, and overall school readiness. Jacob Kirksey, a doctoral student at UCSB, 
helped to analyze the data and co-wrote the report. To our knowledge, theirs is the first study to explore the 


potential effects of Catholic schooling on elementary students’ self-discipline. 


Gottfried and Kirksey analyzed two waves of nationally representative data on elementary school students 
that were collected as part of the Early Childhood Longitudinal Study—-Kindergarten (ECLS-K). The first, 
ECLS-K: 1999, contains data on a nationally representative cohort of children who entered kindergarten in 
1998-99. (Our study includes data from kindergarten, first, third, and fifth grades.) The second, ECLS-K: 
2011, contains data on children who entered kindergarten in the 2010-11 school year. (Our study includes data 
from kindergarten through second grade.) 


Each of these cohorts comprises 15,000 to 17,000 kindergarteners who attended public schools and 1,000 to 
2,000 who attended non-public schools, of whom close to half (41 percent to 49 percent) attended Catholic 
schools. For both cohorts, teachers rated the frequency with which children engaged in certain behaviors 


(thus making possible the authors’ analysis). 


To account for the many readily observable differences between Catholic school students and their peers in 
other private or public schools, Gottfried and Kirksey compared children who attended Catholic schools to 

a subset of students who attended other schools but who closely resembled the Catholic school students 

in other respects. However, because families who send their children to Catholic schools make a conscious 
choice to do so, they likely differ from other families in unobservable ways. So, in addition to comparing 
children who attend Catholic schools to children who attend public schools, the authors also compared them 
to children in other private schools, both religious and secular. Because these families also chose to opt out of 


the public school system, we consider them the most plausible comparison group. 
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The analysis revealed three key findings. 


First, students in Catholic schools are less likely to act out or be disruptive than those in other private or 


public schools. 


Children in Catholic school exhibited fewer “externalizing behaviors”—that is, they demonstrated more 
self-discipline—than matched peers in other private schools. According to their teachers, Catholic school 
children argued, fought, got angry, acted impulsively, and disturbed ongoing activities less frequently. In the 
first cohort, the size of this difference increased over time, from -0.06 standard deviations in kindergarten, 
to -O.27 and -0.29 standard deviations in first and third grades, to -O0.34 standard deviations in fifth grade. 
A similar pattern emerges when comparing children who attend Catholic school to those in public schools, 


though the differences are generally smaller and do not increase over time. 


The second cohort reveals a similar pattern, with children in Catholic schools exhibiting fewer externalizing 
behaviors than those in other private or public schools. However, the difference between Catholic schools and 


other private schools disappeared between kindergarten and second grade. 


Second, students in Catholic schools exhibit more self-control than those in other private schools or 


public schools. 


Teachers at every grade level reported that students in the first cohort (1998-99) who attended Catholic 
schools exhibited greater self-control than those in other private schools. Specifically, they were more likely to 
control their temper, respect others’ property, accept their fellow students’ ideas, and handle peer pressure. 
Like the difference in “externalizing behavior,” this difference is smallest in kindergarten (0.10 standard 


deviations), though in this case there is no clear trend between kindergarten and fifth grade. 


In a similar vein, Catholic school students who entered kindergarten in 2010-11 exhibited more self-control 
than students in other private schools. Moreover, for this cohort, the difference between these groups grows 


steadily over time, from 0.15 standard deviations in kindergarten to 0.26 standard deviations in second grade. 


Third, regardless of demographics, students in Catholic schools exhibit more self-discipline than 


students in other private schools. 


Prior research suggests that Catholic schools do a particularly good job of boosting the achievement of low- 
income and minority students. Consequently, we tested for differences in the relationship between Catholic 
school attendance and externalizing behaviors and/or self-control based on individual characteristics, 
including race, gender, socioeconomic status, and family immigrant status, as well as initial behavior (as rated 


by kindergarten teachers). 


Interestingly, there were no systematic differences between any of these groups. Students in Catholic schools, 
regardless of their personal characteristics or backgrounds, exhibit more self-discipline than students in other 
private or public schools. Thus, there is at least some evidence that attending Catholic school may benefit all 
sorts of children, at least when it comes to reducing the frequency of externalizing behaviors and fostering 


greater self-control. 
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Note that these findings are not causal. Despite the authors’ efforts to construct a plausible control group, 
there may be unobservable differences between Catholic and other private school students, so their estimates 


of the “effect” of Catholic school attendance may be biased. Still, the findings suggest three key takeaways. 


4_. Schools that value and focus on self-discipline will likely do a better job of fostering it in children. 


Since Catholic school doctrine emphasizes the development of self-discipline, it seems likely that Catholic 
schools devote more time and attention to fostering it. And their apparent success in doing so suggests that 
schools that focus on self-discipline are capable of inculcating, developing, and strengthening it over time—in 
the same way that other schools might focus on athletic skills to win track meets or football games. If other 
schools took self-discipline as seriously as Catholic schools do, they would likely have to spend less time, 


energy, and political capital on penalizing students for negative behaviors. 


2. Assuming that these results reflect a “Catholic Schools Effect,” other schools might consider both 


explicit and implicit methods to replicate it. 


In general, we know little about how schools (including Catholic ones) can foster self-discipline. But it seems 
likely that both direct and indirect methods play some role in Catholic schools’ success—and that at least 
some of these methods are transferrable to other contexts. For example, an explicit focus on self-discipline 
might be reflected in a school’s curricula, whether formal or informal. Similarly, a school’s discipline policy 
could enumerate any number of approaches whereby teachers and students could forestall bad behavior. 
Alternatively, higher levels of self-discipline may be fostered implicitly—tor example, through educators’ daily 
interactions with students in the classroom or via well-chosen and well-managed extracurricular activities with 


mentors or other adults who model self-discipline. 


With a bit of effort, more non-Catholic schools could adopt such practices and be intentional about their 


implementation. Indeed, some “no excuses” charter schools are already doing so. 


%._ Don’t underestimate the power of religion to positively influence a child’s behavior. But in the 


absence of it, schools can adopt courses or programs that might foster self-discipline. 


The most obvious feature that Catholic schools and similar faith-based schools have in common is their focus 
on religion—including such specifically Judeo-Christian values as humility, obedience, kindness, tolerance, 
self-sacrifice, and perseverance. It is difficult to pin down whether and how these values, taught in relation 

to the life of Christ, may influence a child’s behavior. Perhaps students are more likely to internalize such 
values when they know they are loved not only by their teachers but by their Creator, or when they perceive 
that misbehavior may have eternal consequences. Maybe it’s something else entirely. Regardless, one thing 

is certain: Religion can mold hearts and minds in ways that suspensions, restorative justice, and Positive 


Behavioral Intervention and Supports (PBIS) can’t begin to match. 


That doesn’t mean that such secular approaches—and schools—don't have their place. Of course they do. 
And so do character education, ethics classes, and civics, all of which can contribute to the development of 


self-discipline. School leaders should choose the options that best suit their kids and culture. 


FOREWORD & EXECUTIVE SUMMARY 8 


That said, our results suggest that Catholic schools in particular are doing something meaningful in the realm 
of self-discipline. So it’s deeply unfair that the politics of education continue to prevent many parents from 
accessing them, and it’s a tragedy for the nation that many of these valuable educational institutions continue 


to close. 


To the extent that school choice programs can widen access to great schools—Catholic or otherwise—that 


boost academic performance and self-discipline, they deserve our eternal support. 
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INTRODUCTION 


Catholic schools are enjoying renewed attention, thanks to the 
current administration's affinity for school choice—and private- 
school choice programs in particular. As the largest provider of 
private education in the United States, Catholic schools would 
likely benefit from the creation of new (Cy augmentation of 
existing) voucher or tax credit scholarship programs, as they 
have from past expansions.’ So now is a good time to revisit the 
ever-important question: Do children benefit from a Catholic 


Ye ltte-talelate 
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Traditionally, Catholic schools have espoused the development of the whole student, with a particular 
emphasis on character formation.” Yet to date, most research has focused on gauging their academic benefits 
(see What Do We Know about Catholic School Effects on Academic Outcomes?). Overall, this literature suggests 
that students in Catholic schools achieve at higher levels than those in other private or public schools. 


However, little is known about these students’ noncognitive skills—especially in elementary school. 


To help fill this gap, the present study 
investigates the degree to which attending 


Age: tae Bom.’ (<M Gavolhtar-tofol ih: 


a Catholic school is associated with the 


noncognitive development of elementary Catholic Yo} Toye) | aa ro} a} 
school children. More specifically, it Academic Outcomes? 
focuses on the relationship between 


attending Catholic school and the ee esececocccccoccececcecceeccccdeccceeeececdeedeeeeddcdedeeedelh 


acquisition of self-discipline—a key tenet 


of Catholic education. This relationship is RAI Tel aol alndaleweVer-Ve (Teale -sni-Lei tie) m Ord ao) olstel atote) GETS 


of particular interest given the increasingly encouraging but mixed. On the one hand, studies have 


heated debate over school discipline in found that students in Catholic high schools achieve at 


public schools, which is in part a product higher levels in math, reading, writing, and social studies 


of some students’ lack of self-discipline. than students in other private and public schools.# 


Clearly, an approach that fosters self- Similarly, studies show that students in Catholic schools 


discipline is preferable to one that relies have higher test scores on college entrance exams,” 


on externally imposed discipline. So greater participation in advanced math and science 


courses,° and higher high school graduation’ as well as 


if Catholic schools have succeeded in 


developing such an approach, we ought to college enrollment rates.® Yet many of these studies suffer 


pay more attention to what they are doing from methodological shortcomings such as selection 


and how they are doing it. bias, sampling error, faulty model specification, and/or 


inappropriate control groups.? 
To that end, this study asks two questions: 
Further, some of the most rigorous studies of Catholic 


Are children in Catholic elementary education have found negative effects. For example, 
schools more self-disciplined than Figlio and Stone (1997) found that attending a Catholic 
similar students in other schools, school (as opposed to a public or non-religious private 
as measured by their likelihood of school) has a negative effect on math and science 
arguing and fighting and ability to achievement.'° Similarly, Kim and Placier (2004) found 
control their temper, among other that Catholic school students exhibit less progress in 
things? reading between eighth and tenth grades than students in 
other private schools." Yet despite the lack of consensus 
Is the relationship between Catholic regarding the impact of Catholic education on students 
school attendance and self- in general, most studies of urban Catholic schools 
discipline stronger for certain types (including the Figlio and Stone study) suggest they are 
of students? more effective than nearby public schools at boosting 


achievement, high school graduation, and college 


enrollment rates of black and Hispanic students. ~ 
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To address these questions, we analyzed two waves of nationally representative data that were collected by the 
National Center for Educational Statistics (NCES), starting in 1998-99 and 2010-11. To our knowledge, this 


study is the first to explore the potential effects of Catholic schooling on elementary students’ self-discipline. 


Catholic Schools in the United States 


The first Catholic school in the United States was established in 1782. And for the next century and a half, 
the Catholic school system experienced almost uninterrupted growth. Total Catholic enrollment peaked in 
the 1960s, when 13,292 Catholic schools enrolled approximately 5.6 million students—or about 89 percent 
of total private enrollment.'> However, in recent decades, Catholic schools have experienced declining 
enrollment and a rapid loss of market share. In the past decade, for example, approximately 14 percent of 
U.S. Catholic schools have closed, and total Catholic school enrollment has declined by almost half a million 
students. Yet Catholic schools still account for 36 percent of private enrollment, making them by far the 
largest provider of non-public education in the United States.'* As of 2014, 6,525 Catholic schools served 
nearly 2 million students, of whom approximately 84 percent were Catholic and roughly one-quarter were 
non-white—a higher percentage than in other private schools.'5" 

Historically, Catholic schools have sought to differentiate themselves from other types of schools by giving 
equal priority to a child’s academic and non-academic development—or “educating the whole child.” In 
contrast, public schools have tended to differentiate themselves based on academic offerings such as language 
immersion or magnet programs. Although there is no national or international code of conduct for Catholic 
schools, most of the dioceses that govern them integrate traditional “Gospel values” such as piety, character, 
and self-discipline (see The Mission of Catholic Schools). In addition to these virtues, Catholic schools are also 


known for teaching service-oriented values such as civic duty, volunteerism, and compassion for those in 


need.” 


Catholic Schools and Noncognitive Skills 


The term noncognitive skills has been criticized as “boring and uninspired,” connoting a “diffuse and jumbled 
set of concepts.” Yet despite the fact that “few aspects of human behavior are devoid of cognition,” it 

remains popular in education circles.'® At the broadest level, noncognitive skills may be thought of as “sets 

of behaviors, skills, attitudes, and strategies that are crucial to academic performance” but that “may not be 
reflected in [students’] scores on cognitive tests.”'9 For example, noncognitive skillsets typically include traits 


such as persistence, self-discipline, focus, confidence, teamwork, organization, seeking help, and staying on 


task (see Which Skills Are Considered “Noncognitive”?). 


Despite this somewhat fuzzy definition, noncognitive skills have been linked to a host of positive outcomes 
including higher academic achievement,~° greater educational attainment, lower odds of being on welfare, 
and lower arrest rates.*' Conversely, poor noncognitive development has been linked to emotional 


maladjustment and long-term health problems. ** 
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Catholic schools operate independently (in accordance with the foXe) Urol Xone dalla Cofer-\ Re [loXet Lalo Kolmrasrore)| 


board), and there is no singular guiding doctrine that governs the entire system. Yet there is much consistency 


in their mission and purpose, especially when it comes to the importance of self-discipline, as demonstrated 


by the following examples: 


Christ the King Catholic School's goal is to lead 
children to self-discipline. We believe that a student 
can be taught self-discipline skills as a part of the total 
school curriculum. Discipline should not be viewed as 


punishment.*3 


“Discipline with Purpose,” Christ the King 
Catholic School (Mesa, AZ) 


The Catholic School advantage is reflected in the 
philosophy that permeates the total education 
program and the lives of the faculty and students. 
This philosophy challenges students to improve the 
world by sharing Gospel values and living Christ's 
message of salvation. They grow to understand 
the roots of their faith and their responsibilities as 
Christians. Students explore their faith through 
classes and activities in Scripture, Sacraments, 
Church, and morality. Catholic Schools stress the 


value of self-discipline and commitment.”° 


“The Catholic School Advantage,” 
Archdiocese of Newark (Newark, N}) 


In 2012 Chilton Area Catholic School adopted the 
“Discipline With Purpose” program. This program 
helps children learn to become self-directed adults. 
lt helps teach responsibility and respect in language 
folVileleaauorolaMvlgte(amycelgte Ml melkveR-iglaell Kole <3 
educators to rethink their role as disciplinarians to 


teachers of self-discipline.*4 


“Discipline,” Chilton Area Catholic School 
(Chilton, WI) 


Parents choosing Catholic school for their children 
frequently cite our commitment to structure and 
discipline as a major reason for their investment in 
Catholic education. Our students are to conduct 
themselves at all times according to Christian 
principles and exhibit the values of their family, the 
Church, and our school community. Good classroom 
order and a tight school structure help to insure the 
rere mey mel Metglicolx-agvm (etal lielemagte elwaliaten (erarel|| 
students, and promote self-control and self-respect in 


the individual child.?° 


“After-School Program Parent Student Guide,” 
St. Mark the Evangelist School (Nea ola aah) 


As these examples demonstrate, Catholic schools generally project a consistent message about the purpose of 


education: Students attend school to learn piety, self-discipline, and the formation of good character, as well 


as academics. 


INTRODUCTION 13 


In the closest precursor to the present study, Peterson and Variengo (2011) found that Catholic schooling has 
a positive impact on eighth grade students’ academic engagement, homework completion, attendance, and 
behavior.*’ And several studies have found that Catholic schools are associated with positive non-academic 
outcomes for adolescents (though it’s not clear whether these differences are fully attributable to the benefits 
of a Catholic education).7° For example, 
students who attend Catholic schools 


are more likely to vote than their public 


school counterparts. Similarly, teenagers Which Skills Are Considered 
who attend Catholic schools have a “Noncognitive”? 
substantially lower risk of engaging in 


sexual activity, using hard drugs, and being YZ 


d than th h d publi 
a dpeiaape ade ose ™ eperee nner WW av-m @roll lolol e-tai\,-mrelay- Ver-Le (taal (ommtofel[-1 Mir-lale Ml at aaKeldfoyar-l| 
schools.*? Catholic primary schools also 


Learning (eX am) groups noncognitive skills into five 


tend to have lower suspension rates and eT hecsicelid 
; core competencies. These include: 
higher attendance than public schools.*° P 


Yet despite the fact that Catholic SELF-AWARENESS, or the ability to accurately 
education targets noncognitive skills, and recognize one’s own emotions, thoughts, and 
self-discipline in particular, no study has values and how they influence behavior; 


examined whether students in Catholic 


elementary schools are more likely to SELF-MANAGEMENT, or the ability to successfully 


exhibit self-discipline than other students. regulate one’s emotions, thoughts, and behaviors 
in different situations—effectively managing stress, 


controlling impulses, and motivating oneself; 


SOCIAL AWARENESS, or the ability to take the 
perspective of and empathize with others, 
including those from diverse backgrounds and 


cultures; 


RELATIONSHIP SKILLS, or the ability to establish 
and maintain healthy and rewarding relationships 


with diverse individuals and groups; and 


RESPONSIBLE DECISION MAKING, or the ability to 
make constructive choices about personal behavior 
Plato mtoYell-l Mlait-le-Cedlolatsioy-i-te Mel al-iialfer-| cie-latel-lce te 


safety concerns, and social norms. 
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DATA @ METHODS 


The data for this report were collected by the National Center 
for Education Statistics (NCES) as part of the Early Childhood 
Longitudinal Study—Kindergarten (ECLS-K). Data for ECLS-K 
were collected in two waves: The first, ECLS—Kindergarten 
Class of 1998-99 (ECLS-K: 1999), contains data on a nationally 
representative cohort of children who entered kindergarten in 
1998-99 and follows them through eighth grade. The second, 
the Early Childhood Longitudinal Study—Kindergarten Class of 
2010-11 (ECLS-K: 2011), contains data on children who entered 
kindergarten in the 2010-11 school year and follows them 
through fifth grade. 


DATA & METHODS 


15 


Both waves of data include information from direct assessments of children’s academic abilities, as well as 


interviews with and surveys of parents, teachers, and school administrators. For the first cohort (ECLS-K: 


1999), data were collected in the fall and spring semesters of the students’ kindergarten year, as well as the 


spring term of first, third, fifth, and eighth grades. However, data related to self-discipline in particular were 
only collected through fifth grade. Similarly, data for the second cohort (ECLS-K: 2011) were collected in 


the fall and spring of kindergarten, as well as the spring term of first, second, third, fourth, and fifth grades. 


However, when the present analysis was undertaken, data from the second cohort were only available through 


second grade (see Table 1). 


Table 1: Data Collection by ECLS—K Cohort 


Kindergarten 1st Grade 2nd Grade 3rd Grade 4th Grade 5th Grade 
Cohort 1 1998-99 1999-00 No data collected 2001-02 No data collected 2003-04 
Cahors Baresn eae Bee Data not available Data not available Data not available 
lds 3 attimeofstudy | attimeofstudy at time of study 


ECLS-K: 1999 includes 16,600 kindergarteners who attended public schools and 1,840 who attended non- 
public schools, of whom 49 percent attended Catholic schools. Similarly, ECLS-K: 2011 includes 15,600 
kindergarteners who attended public schools and 1,090 who attended non-public schools, of whom 41 


percent attended Catholic schools.* 


Measures 


The two ECLS-K datasets include a number of common variables, allowing for comparisons between cohorts 


across a timespan of more than a decade. These variables include: 


TYPE OF SCHOOL a child attended: Catholic, other religious, other private, or public. For this study, we 


combined “other religious” and “other private” schools into a single group that we label “other private.” 


SELF-DISCIPLINE as measured by the frequency with which children engaged in certain behaviors, according 


to their teachers. In ECLS—K, these items are combined into five social-emotional scales that NCES refers to 


collectively as the Social Rating Scale (SRS).3? Of these five scales, two are plausibly related to self-discipline. 


The first, “externalizing behaviors,” is based on five items: the frequency with which a child argued, fought, 


got angry, acted impulsively, and disturbed ongoing activities. The second, “self-control,” is based on four 


items: the extent to which the child was able to control his or her temper, respect others’ property, accept 


peers’ ideas, and handle peer pressure. Both of these scales are continuous, with higher scores indicating more 


frequent behavior.** 


In addition to the survey items described above, ECLS-K also includes data on a host of variables that are 


useful as statistical controls. These include: 
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INDIVIDUAL CHARACTERISTICS such as gender, race, the age at which the child started kindergarten, and 
whether the child attended pre-kindergarten, as well as variables that may change over time such as special 


education status, English language learner status, and grade-retained status. 


PARENT AND HOUSEHOLD CHARACTERISTICS such as whether parents are married, number of books 
at home, number of siblings, frequency of parental home learning activities,*4 access to learning materials at 
home,* mother and father’s education, total household income, and whether the family lived in an urban, 


suburban, or rural neighborhood. 
CLASSROOM DEMOGRAPHICS suchas the percentage of children who are black, Hispanic, and Asian. 


Table 2 summarizes these variables for each ECLS-K cohort (see Appendix Table A-1 for a detailed list). 


Table 2: Descriptive Statistics for Private School Kindergarteners in ECLS—K 


ECLS-K: 1999 ECLS-K: 2011 


Average Average 


Male 
Black 

Hispanic 

Asian 


Parents are married 


Mother education: college or more 


Father education: college or more 


Urban neighborhood 


U.S. region: west 


DATA & METHODS 


17 


Table 2: Descriptive Statistics for Private School Kindergarteners in ECLS—K 


(cont'd) 


U.S. region: north 
U.S. region: south 


Children in cohort 


Methods 


ECLS-K: 1999 ECLS-K: 2011 
Average Average 
20% 20% 

27% 28% 

1,840 1,090 


We used three empirical approaches to test whether students in Catholic schools exhibit higher levels of self- 


discipline. First, we ran a series of regressions with Catholic school attendance as our key independent variable 


(controlling for the variables described above) and our two self-discipline variables (either “externalizing 


behaviors” or “self-control”) as the dependent variables. Next, because there are no Catholic schools in some 


counties, we ran a similar model that included county fixed effects, thus controlling for any unobservable 


county-level characteristics that might bias our estimates. Finally, we ran a propensity-matched model that 


compared a subsample of children who attended Catholic schools to a matched sample of students who did 


not attend them, but who closely resembled Catholic school students in other respects (meaning they hada 


similar propensity to attend a Catholic school). 
In our view, this last approach is the strongest 

of the three because it restricts the comparison 
group to the children who most resemble those 
in Catholic schools. (See Appendix for additional 
details.) 


Because families who send their children to 
Catholic schools make a choice, they may 

differ from those who do not exercise school 
choice in unobservable ways (see Limitations). 
Consequently, in addition to comparing children 
who attend Catholic schools to children who 
attend public schools, we also compare them to 
children in other non-public alternatives (i.e., 
private schools, religious, or other). Because 
these families also chose to opt out of the public 
school system, we consider them the most 
plausible comparison group. (Note, however, 
that the results for public school children are 


broadly similar to the results for private school 


children.) 


Limitations 


LL hh dsdsssdgiiciiddddddddadddadddadddaddaadddaddddddddddddda 


This study has several limitations: First, despite 
our efforts to construct a plausible control group, 
there may be unobservable differences between 
Catholic and other private school students, so 
our estimates of the effect of Catholic school 
attendance may be biased. Second, the ratings 

of students’ noncognitive skills on which this 
study is based were generated by teachers, 


whose judgments are necessarily subjective at 


some level.3® Finally, because our measures of 


self-discipline are aggregated, we do not observe 
differences or changes for individual scale items. 
So we may be missing an important part of the 


story. 
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FINDINGS 


4, Students in Catholic schools are less likely to act out or be 


disruptive than those in other private or public eYel aLote) 
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Students in Catholic schools are less likely to act out 
or be disruptive than those in other private or public 


schools. 
WILL LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL 


Figure 1 presents the externalizing behavior results for the first cohort of ECLS—K kindergartners, from 
1998-99 onward, based on our propensity-matched model. (Lower values indicate fewer externalizing 
behaviors.) In every year that data were collected for this cohort, children in Catholic schools exhibited fewer 
externalizing behaviors—that is, more self-discipline—than matched peers in other private schools, according 
to their teachers. Moreover, the size of this difference increased over time, from -0.06 standard deviations in 
kindergarten to -O.27 and -0.29 standards deviations in first and third grades, to -0.34 standard deviations 
in fifth grade. A similar pattern also appears when comparing children who attended Catholic school to those 
who attended public schools (also Figure 1). However, the latter estimates are generally smaller in magnitude 
and do not increase over time in the same manner. (Full results for both the public and other private school 


comparisons can be found in Appendix Table A-2.) 


Figure 1: Catholic School Students in ECLS—K: 1999 Exhibit Fewer 
Externalizing Behaviors than Students in Other Private or Public Schools. 
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How to read this figure: Per the third pair of bar graphs, Catholic school students in third grade exhibit -0.29 and -0.14 standard deviations 
fewer externalizing behaviors than students in other private and public schools, respectively. Lower values indicate fewer externalizing 
behaviors in Catholic school students relative to their counterparts in other private and public schools, as measured by the frequency with which 
achild argued, fought, got angry, acted impulsively, and disturbed ongoing activities (*** p<o.001, ** p<O.01, *p<0O.05, + p<O.10). 
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As shown in Figure 2, the estimates for the 2011 cohort exhibit a similar pattern, with children in Catholic 
schools exhibiting fewer externalizing behaviors than those in other private or public schools. However, for 
this cohort, the difference between children in Catholic schools and those in other private schools disappears 


between kindergarten and second grade. 


Figure 2: Catholic School Students in ECLS—K: 2011 Exhibit Fewer 
Externalizing Behaviors than Students in Other Private or Public Schools. 
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How to read this figure: Per the second pair of bar graphs, Catholic school students in first grade exhibit -0.21 and -0.07 standard deviations 
fewer externalizing behaviors than students in other private and public schools, respectively. Lower values indicate fewer externalizing 
behaviors in Catholic school students relative to their counterparts in other private and public schools, as measured by the frequency with which 
a child argued, fought, got angry, acted impulsively, and disturbed ongoing activities (*** p<o.001, ** p<0.01, *p<O.05, + p<O.10). 


Students in Catholic schools exhibit more self-control 
than those in other private schools or public schools. 
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As shown in Figure 3, teachers at every grade level reported that children in the 1998-99 cohort who 
attended Catholic schools exhibited greater self-control than those in other private schools. Specifically, they 
were more likely to control their temper, respect others’ property, accept their peers’ ideas, and handle peer 
pressure. Like the difference in “externalizing behaviors,” this difference is smallest in kindergarten (0.10 
standard deviations), though in this case there is no clear trend between kindergarten and fifth grade. And the 
gap between public school and Catholic school students disappears between kindergarten and fifth grade. 


In a similar vein, Catholic school students who entered kindergarten in the 2010-11 cohort exhibit more 
self-control than students in other private schools (see Figure 4). Moreover, for this cohort, the difference 
between these groups grows steadily over time, from 0.15 standard deviations in kindergarten to 0.26 


standard deviations in second grade. 
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Figure 3: Catholic School Students in ECLS—K: 1999 Exhibit More 
Self-control than Students in Other Private or Public Schools. 
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How to read this figure: Per the third pair of bar graphs, Catholic school students in third grade exhibit 0.14 and 0.08 standard deviations 
more self-control than students in other private and public schools, respectively. Higher values indicate more instances of self-control in Catholic 
school students relative to their counterparts in other private and public schools, as measured by the frequency with which children controlled 
their temper, respected others’ property, accepted peers’ ideas, and handled peer pressure (*** p<o.001, ** p<0.01, *p<O.O5, + p<0O.10). 


Figure 4: Catholic School Students in ECLS—K: 2011 Exhibit More 
Self-control than Students in Other Private Schools. 
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How to read this figure: Per the third pair of bar graphs, Catholic school students in second grade exhibit 0.26 standard deviations more 
self-control than students in other private schools, respectively. Higher values indicate more instances of self-control in Catholic school students 
relative to their counterparts in other private and public schools, as measured by the frequency with which children controlled their temper, 
respected others’ property, accepted peers’ ideas, and handled peer pressure (*** p<0.001, ** p<0O.01, *p<O.O5, + p<O.10). 
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Regardless of their demographics, students in Catholic 
schools exhibit more self-discipline than students in 
other private or public schools. 


Prior research suggests that Catholic schools are likely to boost the achievement of low-income and minority 


students.°/ Consequently, we tested for differences in the relationship between Catholic school attendance 


and externalizing behaviors and/or self-control based on individual characteristics, including race, gender, 


socioeconomic status, and (parent-reported) family immigrant status, as well as initial behavior (as rated by 


kindergarten teachers at the beginning of the school year). 


Interestingly, there were no systematic differences between any of these groups. (See Appendix Table A-3 


for these results.) Students in Catholic schools, regardless of their personal characteristics or backgrounds, 


exhibit more self-discipline than students in other private or public schools. Thus, there is at least some 


evidence that attending Catholic school may benefit all sorts of children, at least when it comes to reducing 


the frequency of externalizing behaviors and fostering greater self-control. (See Catholic Schooling and Other 


Noncognitive Measures for other results.) 
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In addition to externalizing behaviors and self- 
control, the ECLS-K surveys ask teachers to report 
how often a child engages in other socio-emotional 
behaviors that are not related to self-discipline. 
These items are the basis for three additional scales: 
The five-item interpersonal skills scale measures 
whether a child is able to get along with others, 
form and maintain friendships, help other children, 
show sensitivity to the feelings of others, and 
express feelings, ideas, and opinions in positive 
ways. The six-item approaches to learning scale 
measures whether the child is able to keep his or her 
belongings organized, show eagerness to learn new 


things, adapt to change, persist in completing tasks, 
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pay attention, and follow classroom rules. Finally, 
the four-item internalizing behaviors scale measures 
the extent that the child exhibits anxiety, loneliness, 


low self-esteem, and sadness. 


Strikingly, our study showed no statistically 
significant links between attending Catholic school 
and a child’s score on any of these other scales. In 
our view, these null findings lend further credibility 
to our primary findings, since there is no obvious 
connection between Catholic pedagogy and these 
other behaviors, unlike the behaviors associated 


with self-discipline. 


DISCUSSION 


Our results show that students in Catholic schools have 

higher reported levels of self-discipline across two measures 
(externalizing behaviors and self-control), as well as across two 
cohorts and multiple grades. Furthermore, for each of those 
measures, data from at least one cohort suggest that the gap 
between Catholic students and other private school students 


grew over time. 
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On balance, these findings suggest that Catholic schools may have an advantage over other schools when it 
comes to fostering self-discipline—an interpretation rendered more plausible by the fact that Catholic school 
doctrine explicitly supports the development of these skills. However, we cannot say for certain if children 
who enroll in Catholic schools have higher levels of self-discipline, or if the reported differences in behavior 


are attributable to what goes on inside the school (see Limitations on page 17); 


Insofar as these results reflect a “Catholic Schools Effect,” it’s worth considering what might explain it. 

In general, we know very little about how educators can foster noncognitive skills such as self-discipline. 
However, most potential explanations fall into one of two categories: First, improved self-discipline could be 
driven by an explicit focus on self-discipline-related themes at the school or classroom level. As noted in The 
Mission of Catholic Schools (page 12),a cursory review of school mission statements suggests that Catholic 
schools prioritize self-discipline. So it’s not too great a leap to suggest that this focus may be reflected in their 
curricula or discipline policies, whether formal or informal. In general, schools tend to excel at the things they 
value. Moreover, because Catholic schools are unabashedly religious, they expect their students to conduct 
themselves according to Christian principles and to recognize that doing otherwise has both immediate and 


potentially eternal consequences. 


Second, higher levels of self-discipline may be fostered implicitly. For example, research suggests that Catholic 
school personnel demonstrate an “ethic of caring” that fosters stronger community values in schools,2? and 

it seems highly plausible that they are also models of self-discipline. Thus, even if they do not preach self- 
discipline (literally or figuratively) teachers and other staff may be imparting its value in their interactions with 


students. 


Because we can only speculate about these potential mechanisms, the lessons that our findings hold for 
non-Catholic schools are not as clear as they might be. Certainly, other schools might choose to focus on 
self-discipline or other noncognitive skills more explicitly and intensely by incorporating them into their 
curriculum, extracurricular activities, or discipline policies.*9 But the clearest implication of our results is that 
Catholic schools offer an important alternative for families who may be dissatisfied with their local public 


schools—particularly if they are interested in cultivating a sense of self-discipline and restraint. 
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The most straightforward way to compare children who did and did not attend Catholic school is to runa 


baseline regression model using Ordinary Least Squares (OLS): 
ve? OCS, = XB ae 


where Y represents one of the self-discipline measures for child i in the spring of year t. Y is a standardized 
measure, such that the effect of attending Catholic school can be interpreted as an effect size. The key 
measure in this study is CS. which is a binary indicator for having attended Catholic school in year t. X;, is 

a vector of child, classroom, and family variables. E,, is the error term, which is cluster-adjusted for the fact 
that children are nested within the same schools.*° Despite the unusually rich set of control variables in the 
baseline model, however, there may still have been other (unobserved) factors that influence the choice to 
attend Catholic school, such as the availability of Catholic schools as an option. To account for this, in some 


specifications, we include county fixed effects to control for variation in school options at the county level. 


Propensity Matching 


A common alternative to OLS and fixed effects models is “propensity matching.”*' In a propensity-matching 
model, the analysis occurs in two stages: In the first stage, the probability of receiving the treatment (i.e., the 
“propensity score”) is estimated based on observable characteristics (i.e., the control variables described 
previously). Thus, each child is assigned a score that reflects their odds of attending a Catholic school based 
on everything else that is known about them. In the second stage, propensity scores are used to match 

children who attended Catholic schools to those children who did not attend Catholic school but hada 
similar propensity to do so. More specifically, we used a form of “stratification matching” that divides children 
with similar characteristics and propensities to attend Catholic school into strata, and then makes comparisons 


between Catholic and non-Catholic students within these strata.47 


Note that results for the other empirical models are available upon request. 
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Table A-1: Descriptive Statistics 


ECLS-K: 1999 ECLS-K: 2011 
Standard Standard 
Average Deviation Average Deviation 


Externalizing behaviors 


Self-control 


as 

Black 0.07 0.26 oO. 0.31 
Hispanic 0.12 0.32 0.12 0.32 
Asian 0.04 0.20 0.10 0.30 
Other race 0.04 0.21 0.07 0.26 
Special education 0.13 0.34 0.16 0.37 
English language learner 0.12 0.32 Ou. 0.31 
Retained 0.05 0.22 0.91 0.28 
Attended pre-kindergarten 0.84 0.37 0.96 0.21 
Percentage of classmates: Black 7.63 16.94 

Percentage of classmates: Hispanic 4.00 9.89 
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Table A-1: Descriptive Statistics (cont'd) 


Parents are married 


ECLS-K: 1999 


Average 


Standard 


Deviation 


ECLS-K: 2011 


Average 


27 


Standard 


Deviatio 


U.S. region: south 


Number of books 95.94 60.06 119.30 186.40 
Number of siblings 1.29 1.03 1.26 1.00 
Home learning activities 2.81 0.44 3.21 0.55 
Home cognitive stimulation 178 1.54 274 1.16 
Mother education: some college 0.54 0.50 0.24 0.43 
Mother education: college or more 0.43 0.49 0.66 0.48 
Father education: some college 0.42 0.49 0.22 0.42 
Father education: college or more 0.45 0.50 0.53 0.50 
Total income $84,176 $86,464 $139,217 $89,130 
Urban neighborhood 0.53 0.50 0.34 0.47 
Suburban neighhood 0.30 0.46 0.45 0.50 
U.S. region: west 0.20 0.40 0.20 0.40 
U.S. region: north 0.20 0.40 0.20 0.40 
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Table A-2: Standardized Estimates of the Effect of Catholic School 


Attendance on Self-discipline 


Cohort 


ECLS-K: 
1999 


ECLS-K: 
2011 


*# 5 <0.001, ** p<O.Ol, *p<O.05, + p<O.10 


Grade Level 


Private 


Public 


Kindergarten “0:00 =u) 
(0.02) (0.03) 
ist Grade =O year -0.09** 
(0.04) (0.02) 

3rd Grade =O. 20505 -0.14** 
(0.04) (0.03) 

5th Grade =O). Zyl -0.10** 
(0.19) (0.03) 

Kindergarten “O10” -0.03 
(0.08) (0.03) 

ist Grade =O ),aif -0.07* 
(0.01) (0.03) 

2nd Grade 0.00 -0.02 
(0.06) (0.04) 


Robust standard errors in parentheses. 


Cohort 


ECLS-K: 
1999 


ECLS-K: 
2011 


Grade Level 


Private 


28 


Public 


Kindergarten 0.10* Ouse 
(0.05) (0.04) 
ist Grade OM yeas 0.02 
(0.05) (0.04) 
3rd Grade Onl Agia 0.08** 
(0.03) (0.02) 
5th Grade Oi -0.01 
(0.05) (0.02) 
Kindergarten = 0..15** 0.00 
(0.03) (0.03) 
ist Grade 0.19* -0.06 
(0.09) (0.04) 
2nd Grade Owe -0.02 
(0.03) (0.02) 


Each cell represents the effect size on Catholic school students from a unique regression. 


Each regression includes control variables for: gender, race, special education, English language learner, retained, age 


in kindergarten, pre-kindergarten attendance, classroom racial composition, whether parents were married, number of 


books at home, number of siblings, a scale measuring frequency of parental home learning activities, a scale measuring 


access to learning materials at home, mother and father education, and total income. 
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Table A-3: Estimates of the Differential Effects of Catholic School 
Attendance on Self-discipline for Demographic Subgroups 


Cohort Grade Level Males Low Income Eyeeielcing Effect Size 
Extemalisinghehmvors 

Kindergarten -0.02 0.01 -0.03 -0.04 
(0.06) (0.04) (0.07) (0.11) 
ist Grade -0.03 -0.04 Onis 0.33 
ECLS-K: (0.06) (0.05) (0.10) (0.16) 
1999 3rd Grade -0.05 -O.10+ Ons 0.36 
(0.08) (0.05) (0.08) (0.16) 
5th Grade -0.07 -0.06 -0.08 -0.14 
(0.10) (0.07) (0.10) (0.18) 
Kindergarten -0.10 0.07 0.17 0.26 
(0.13) (0.13) (0.17) (0.27) 
ECLS-K: ist Grade -0.08 0.00 OrAOmas 0.65 
eon (0.08) (0.07) (0.11) (0.17) 
2nd Grade -0.09 0.05 -0.06 0.09 
(0.09) (0.08) (0.11) (0.17) 


*# <O0.001, ** p<O.01, * p<O.05, + p<O.10 
Robust standard errors in parentheses. 
Each cell represents the effect size on Catholic school students from a unique regression. 


Each regression includes control variables for: gender, race, special education, English language learner, retained, 
age in kindergarten, pre-kindergarten attendance, classroom racial composition, whether parents were married, 
number of books at home, number of siblings, a scale measuring frequency of parental home learning activities, a 


scale measuring access to learning materials at home, mother and father education, and total income. 
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Table A-3: Estimates of the Differential Effects of Catholic School 
Attendance on Self-discipline for Demographic Subgroups (cont'd) 


High Self- 
Cohort Grade Level Males Low Income control Effect Size 
a 
Kindergarten -0.03 -0.03 0.01 0.02 
(0.06) (0.05) (0.05) (0.08) 
ist Grade -0.03 0.09+ 0.10 0.17 
ECLS-K: (0.07) (0.05) (0.07) (0.11) 
1999 3rd Grade 0.09 Ones 0.03 0.05 
(0.08) (0.06) (0.06) (0.10) 
5th Grade 0.13 0.02 -0.15* -0.24 
(0.10) (0.08) (0.07) (0.11) 
Kindergarten -0.02 0.00 -0.04 -0.07 
(0.12) (0.10) (0.06) (0.09) 
ECLS-K: ist Grade 0.00 0.09 Om 0.56 
eo (0.08) (0.08) (0.08) (0.13) 
2nd Grade 0.08 -0.09 -0.06 -0.09 
(0.09) (0.08) (0.08) (0.13) 


*# <0.001, ** p<O.01, *p<O.05, + p<O.10 


Robust standard errors in parentheses. 
Each cell represents the effect size on Catholic school students from a unique regression. 


Each regression includes control variables for: gender, race, special education, English language learner, retained, 
age in kindergarten, pre-kindergarten attendance, classroom racial composition, whether parents were married, 
number of books at home, number of siblings, a scale measuring frequency of parental home learning activities, a 


scale measuring access to learning materials at home, mother and father education, and total income. 
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